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SYSTEM AND METHOD FOR DETECTING DIFFERENCES 
BETWEEN COMPLEX IMAGES 

CROSS REFERENCE TO RELATED APPLICATION 

This application claims priority from U.S. 
Provisional Patent Application Serial No. 60/410,154, 
filed September 12, 2002 by Edgar Voelkl, and entitled 
^Focus/Aberration Correction in a Digital Holographic 
System," and U.S. Provisional Patent Application Serial 
No. 60/410,156, filed September 12, 2002 by Edgar Voelkl, 
and entitled "Wave Front Matching." 

TECHNICAL FIELD OF THE INVENTION 

This invention relates in general to the field of 
image processing and, more particularly, to a system and 
method for detecting differences between complex images. 
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BACKGROUND OF THE INVENTION 

In a direct-to-digital holography system, holograms 
from highly similar objects can be obtained. Consecutive 
processing of the holograms allows comparison of actual 
5 image waves of the objects. These image waves contain 
significantly more information for both small and large 
details of the objects than conventional non-holographic 
images, because image phase information is retained in 
the holograms, but lost in conventional images. 

10 To find small differences in highly similar objects, 

it is important that the holography system remains in a 
stable state. Small changes, however, may occur within 
the system during the time between acquisition of the 
holograms associated with the highly similar objects. 

15 Other changes may occur because the object may not be 
positioned exactly the same way at different locations, 
e.g., the objects may be at a different focus at 
different locations. Both of the system specific and the 
location dependent changes can cause artifacts (e.g., 

20 artificial or virtual differences) to occur when 

determining if differences exist between these objects. 
If no system specific and/or location dependent changes 
occurred, the measured differences would unambiguously 
determine the actual difference between the objects. 

25 In some applications, such as defect inspection for 

a semiconductor wafer, the holography system may be used 
to acquire multiple images from different locations on 
objects that were meant to be identical. Although the 
objects at different locations may be highly similar, the 

30 aberration values, e.g., focus, at each location may 

differ and thus the images from different locations may 
appear to be different. In conventional image 
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acquisition systems, an image from one location on the 
object may be obtained. The system then moves to another 
location on the object that includes an image having 
approximately the same features. The system obtains an 
5 image at the second location and determines the 

difference in focus values between the first and second 
images. If the focus values between the two images 
differ, the system adjusts the focus values associated 
with the second image to approximately match the focus 

10 values associated with the first image and re-acquires 
the second image with the adjusted focus values. This 
process more than doubles the time required to obtain the 
image from the second location and can increase the cost 
associated with obtaining multiple images from one 

15 object. 

Holographic images differ from real images because 
holographic images contain intensity and phase 
information while real images only contain intensity 
information. The additional phase information in 

2 0 holographic imaging adds a new dimension of complexity, 
as well as new possibilities beyond standard image 
processing tools and capabilities. For example, wave 
front matching capabilities would have little merit for 
intensity images (e.g., real images), whereas they are 

25 important for image waves (e.g., complex images), as they 
address the phase in the image wave that does not exist 
in the intensity image. 

Complex images, like real images, include high 
frequency portions and low frequency portions. 

30 Typically, actual differences in the images will occur in 
the high frequency components of the images. Any 
location dependent or system specific changes, however, 
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may cause artificial or virtual differences in both the 
high frequency and low frequency components of the 
images. In some complex images, the low frequency 
portions of two different images may be different due to 
the small system specific changes, such as minor air 
turbulences. The low frequency differences may create 
artificial differences between the images such that the 
system cannot accurately determine the actual high 
frequency differences between the images. 

In standard image processing, a Fourier filter may 
be applied to both images and a low pass filter may be 
used to obtain the low frequency portion of both images. 
An inverse Fourier filter may then be used to convert the 
images back to the time domain such that the two images 
can be compared. This solution, however, does not 
eliminate the low frequency portions of complex images 
due to the additional phase information contained in the 
image waves . 
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SUMMARY OF THE INVENTION 

In accordance with the teachings of the present 
invention, disadvantages and problems associated with 
detecting differences between images have been 
5 substantially reduced or eliminated. In a particular 
embodiment, a method for detecting differences between 
complex images includes correcting an aberration value 
difference by modifying a first complex image by an 
aberration function and comparing the modified image to a 

10 second complex image, thus, minimizing the difference 
between the complex images in the high frequency range. 

In accordance with one embodiment of the present 
invention, a method for detecting differences between 
images includes acquiring a first complex image and a 

15 second complex image and applying a low pass filter to a 
ratio of the first and second complex images to obtain a 
low frequency ratio. The second complex image is 
modified by the low frequency ratio to replace low 
frequency components of the second complex image with low 

2 0 frequency components of the first complex image. The 

modified complex image is then compared to the first 
complex image to determine if the second complex image 
matches the first complex image. 

In accordance with another embodiment of the present 
25 invention, a system for detecting differences between 

images includes a digital recorder for acquiring a first 
complex image and a second complex image and processing 
resources coupled to the digital recorder. The 
processing resources apply a low pass filter to a ratio 

3 0 of the first and second complex images to obtain a low 

frequency ratio. The second complex image is modified by 
the low frequency ratio to replace low frequency 
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components of the second complex image with low frequency 
components of the first complex image. The modified 
complex image is compared to the first complex image to 
determine if the second complex image matches the first 
5 complex image. 

In accordance with a further embodiment of the 
present invention, a method for detecting differences 
between complex images includes acquiring a first complex 
image and a second complex image that have similar 

10 features and selecting a plurality of aberration values 
for the first complex image from an anticipated 
aberration range. An aberration function is computed for 
each of the aberration values and the first complex image 
is iteratively modified by each of the aberration 

15 functions. The modified complex image is compared with 
the second complex image and an aberration correction 
value is determined by selecting the aberration value 
that yields the smallest difference between the modified 
complex image and the second complex image, 

2 0 In accordance with an additional embodiment of the 

present invention, a system for detecting differences 
between complex images includes a digital recorder for 
acquiring a first complex image and a second complex 
image having similar features and processing resources 

25 coupled to the digital recorder. The processing 

resources select a plurality of aberration values for the 
first complex image from an anticipated aberration range 
and compute an aberration function for each of the 
aberration values. The first complex image is 

30 iteratively modified by each of the aberration functions 
and the modified complex image is compared with the 
second complex image. The processing resources determine 
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an aberration correction value by selecting the 
aberration value that yields the smallest difference 
between the modified complex image and the second complex 
image . 

5 In accordance with another embodiment of the present 

invention, a method for detecting differences between 
complex images includes acquiring a first complex image 
and a second complex image having similar features and 
determining if an aberration value difference exists 

10 between the first and second complex images. The 

aberration value difference is corrected by iteratively 
modifying the first complex image by an aberration 
function and comparing the modified first complex image 
with the second complex image in a high frequency range. 

15 The method further determines if the modified first 
complex image matches the second complex image by 
modifying the second complex image with a low frequency 
ratio to replace low frequency components of the second 
complex image with low frequency components of the first 

20 complex image. The high frequency components of the 
modified first complex image and the modified second 
complex images are then compared to determine if the 
first complex image matches the second complex image. 
Important technical advantages of certain 

25 embodiments of the present invention include a digital - 
to-direct system that reduces the amount of time needed 
to acquire multiple images from an object. In some 
applications, the system may be used to acquire images 
from different locations on the object. Aberration 

30 values associated with each of the acquired images may be 
different. Instead of re-acquiring an image with 
adjusted aberration values, the system adjusts a first 
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image with the aberration values associated with a second 
image . 

Another important technical advantage of certain 
embodiments of the present invention includes a direct - 
5 to-digital holography system that eliminates artifacts 
from an acquired image. Small changes in the system may 
occur between a time when a first image is acquired and a 
second image is acquired. These small changes typically 
occur in low frequency components of the acquired images. 

10 The system applies a low frequency filter to a ratio of 
two acquired images and multiplies one of the images by 
the ratio to eliminate the low frequency components from 
the image comparison. Thus, only the high frequency 
components of the images are compared, which allows the 

15 system to accurately determine if any actual differences 
exist between the two images. 

All, some, or none of these technical advantages may 
be present in various embodiments of the present 
invention. Other technical advantages will be readily 

2 0 apparent to one skilled in the art from the following 
figures, descriptions, and claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete understanding of the present 
invention and advantages thereof may be acquired by 
referring to the following description taken in 
5 conjunction with the accompanying drawings, in which like 
reference numbers indicate like features, and wherein: 

FIGURE 1 illustrates a schematic view of a direct- 
to-digital holography system in accordance with teachings 
of the present invention; 
10 FIGURE 2 illustrates a schematic view of another 

direct -to-digital holography system in accordance with 
teachings of the present invention; 

FIGURE 3 illustrates two complex images obtained by 
a direct -to-digital holography system and the resulting 
15 image after determining and applying an aberration 

correction value in accordance with the teachings of the 
present invention; 

FIGURE 4 illustrates a complex image obtained by a 
direct-to-digital holography system without compensation 
2 0 for artifacts caused by changes in the holography system; 

FIGURE 5 illustrates the complex image of FIGURE 4 
after eliminating the artifacts in accordance with the 
teachings of the present invention; and 

FIGURE 6 illustrates a flow chart of a method for 
25 detecting differences between complex images in 

accordance with teachings of the present invention. 
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DETAILED DESCRIPTION 

Preferred embodiments of the present invention and 
their advantages are best understood by reference to 
FIGURES 1 through 6, where like numbers are used to 
5 indicate like and corresponding parts. 

The following invention generally relates to digital 
holographic imaging systems and applications as described 
in U.S. Patent No. 6,078,392 entitled Direct -to-Digital 
Holography and Holovision, U.S. Patent No. 6,525,821 

10 entitled, Acquisition and Replay Systems for Direct to 
Digital Holography and Holovision, U.S. Patent 
Application Serial no. 09/949,266 entitled System and 
Method for Correlated Noise Removal in Complex Imaging 
Systems, now U.S. Patent No. and U.S. Patent 

15 Application Serial No. 09/949,423 entitled, System and 
Method for Registering Complex Images, now U.S. Patent 

No. , all of which are incorporated herein by 

reference . 

FIGURE 1 illustrates a schematic view of direct-to- 
20 digital holography system 10. System 10 includes laser 
12, beam expander/spatial filter 14, lens 16, 
beamsplitter 18, target 20, focusing lens 22 and mirror 
24. In the illustrated embodiment, laser 12 directs a 
beam of light toward expander/filter 14 and the 
25 expanded/ filtered light travels through lens 16 to 

beamsplitter 18. Beamsplitter 18 may be any optical 
element that allows a portion of the beam to be 
transmitted and a portion of the beam to be reflected. 
In one embodiment, beamsplitter 18 may be a 50/50 
30 beamsplitter where approximately fifty percent (50%) of a 
beam is reflected and approximately fifty percent (50%) 
of the beam is transmitted. In other embodiments, 



AUS0 1:325029.1 



ATTORNEY DOCKET 
068062.0167 



11 



PATENT APPLICATION 



beamsplitter 18 may reflect and/or transmit any suitable 
percentage of light. Beamsplitter 18 may include, but is 
not limited to, a cube beamsplitter and a plate 
beamsplitter . 

The expanded/ filtered light that is reflected by the 
beamsplitter constitutes target beam 26 which travels 
toward target 20. In one embodiment, target 2 0 may be an 
electronic device fabricated from silicon, germanium or 
any compound containing group III and/or group V 
elements. In another embodiment, target 20 may be a 
photomask or reticle that includes a pattern formed on a 
substrate. In other embodiments, target 20 may be any 
other object, assembly or component from which a complex 
image may be generated. A portion of the light reflected 
from target 2 0 then passes through beamsplitter 18 and 
travels toward focusing lens 22. Focusing lens 22 may 
operate to focus target 2 0 into the focal plane of a 
digital recorder (not expressly shown) . Focusing lens 22 
may further provide magnification or demagnif ication, as 
desired, by using lenses of different focal length and 
adjusting the corresponding spatial geometry (e.g., ratio 
of object distance to image distance) . The focused light 
then travels to the digital recorder. In one embodiment, 
the digital recorder may be a high resolution charge 
coupled device (CCD) camera that may record and playback 
a hologram acquired from target 20. The digital recorder 
may further be interfaced with a computer (not expressly 
shown) that includes processing resources . In one 
embodiment, the processing resources may be one or a 
combination of a microprocessor, a microcontroller, a 
digital signal processor (DSP) or any other digital 
circuitry configured to process information. 
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The portion of the light from lens 16 that is 
transmitted through beamsplitter 18 constitutes reference 
beam 28. Reference beam 28 is reflected from reference 
mirror 24 at a small angle. The reflected reference beam 
5 from reference mirror 24 then travels toward beamsplitter 
18. The portion of the reflected reference beam that is 
reflected by beamsplitter 18 then travels toward focusing 
lens 22. The reference beam from focusing lens 22 then 
travels toward the digital recorder. Together, the 

10 object beam and reference beam from focusing lens 22 
constitute a plurality of simultaneous reference and 
object waves 3 0 that form a hologram. 

System 10 may use a "Michelson" geometry (e.g., the 
geometrical relationship of beamsplitter 18, reference 

15 beam mirror 24, and the digital recorder resembles a 

Michelson interferometer geometry) . This geometry allows 
the reference beam and the object beam at focusing lens 
22 to be combined at a very small angle. For example, 
reference mirror 24 may be tilted to create the small 

20 angle that makes the spatially heterodyne or sideband 
fringes for Fourier analysis of the hologram. 

FIGURE 2 illustrates a schematic view of another 
example embodiment of direct-to-digital holography system 
40. System 40 includes laser 12, variable attenuator 42, 

25 variable beamsplitter 44, a target arm, a reference arm, 
beam combiner 54 and digital recorder 56. The target arm 
may include target beam expander 46, target beamsplitter 
48, target objective 50, target 20 and target tube lens 
52 . The reference arm may include reference beam 

3 0 expander 58, reference beamsplitter 60, reference 

objective 62, reference mirror 24 and reference tube lens 
64. In the illustrated embodiment, laser 12 directs a 
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beam of light toward variable attenuator 42 and the 
attenuated light travels to variable beamsplitter 44. 
Variable beamsplitter 44 may be an optical element that 
transmits a portion of the beam and reflects another 
5 portion of the beam. In the illustrated embodiment, 
variable beamsplitter 44 splits the beam of light into 
target beam 66 and reference beam 68. 

Still referring to FIGURE 2, target beam 66 is 
directed through target beam expander 4 6 toward target 

10 beamsplitter 48, which reflects a portion of target beam 
66 toward target objective 50. The reflected target beam 
then interacts with target 2 0 and passes back through 
target objective 50. Target beamsplitter 48 transmits 
the portion of the reflected target beam received from 

15 target objective 50 to beam combiner 54 via target tube 
lens 52. In the reference arm, reference beam 68 from 
variable beamsplitter 44 passes through reference beam 
expander 58 and is reflected by reference beamsplitter 
60, The reflected portion of reference beam 68 passes 

2 0 through reference objective 62 and is reflected by 

reference mirror 24. The reflected reference beam then 
passes back through reference objective 62 and is 
transmitted by reference beamsplitter 60. Reference tube 
lens 64 directs the beam toward beam combiner 54, which 
25 combines light from the target arm and the reference arm 
and directs the combined beams to digital recorder 56. 
In one embodiment, the combined beams may be digital data 
that be recorded, transmitted and/or transformed. 

System 4 0 may use a Mach-Zender geometry. Comparing 

3 0 the Mach-Zender geometry of FIGURE 2 (called Mach-Zender 

because of its similarity to the geometry of a Mach- 
Zender interferometer) with the Michelson geometry (as 
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illustrated in FIGURE 1) , it can be appreciated that the 
focusing lens (e.g., target objective 50 in FIGURE 2) can 
be much closer to target 20 because through- the -lens 
illumination allows target beamsplitter 48 to be behind 
target objective 50 rather than between target objective 
50 and target 20. This allows large numerical aperture, 
high magnification objectives to be used to look at (and 
record holograms of) small objects. For large objects 
the original Michelson geometry as illustrated in FIGURE 
1 may be preferable, depending on the situation. 

It can also be appreciated from FIGURE 2 that beam 
combiner 54 may be located close to digital recorder 56. 
Beam combiner 54 may combine reference beam 66 and object 
beam 68 to illuminate digital recorder 56. The angle of 
beam combiner 54 may be varied so that the reference and 
object beams are exactly co-linear, or in general strike 
digital recorder 56 at an angle to one another so that 
the heterodyne carrier fringes are produced. This allows 
the carrier fringe frequency to be varied from zero to 
the Nyquist limit of digital recorder 56. Beam combiner 
54 may be closer to digital recorder 56 than with the 
Michelson geometry, at least for magnifying geometries 
(e.g., geometries where the object hologram is being 
magnified for acquisition by the digital camera) . This 
allows the combining angle between the object and 
reference beams to be relatively large without causing 
the spots from the reference and object beams to no 
longer overlap at digital recorder 56. This allows much 
finer control over the carrier frequency fringes. In 
fact, it may be possible to vary the angle between the 
two beams from zero up to the maximum angle allowed by 
the constraints of the system without the spatial carrier 
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frequency of the heterodyne hologram exceeding the 
Nyquist frequency allowed by the digital recorder (e.g., 
the angle can be increased until there are only two 
pixels per fringe of the spatial carrier frequency - 
beyond this angle the spatial carrier frequency is no 
longer correctly recorded by the digital recorder) . With 
the Michelson geometry, the maximum spatial carrier 
frequency of the hologram may not be reachable because 
the angle required may be large enough that the reference 
and object beams would no longer overlap at the digital 
recorder for some geometries. 

In operation, systems 10 and 40 may be suitable for 
recording and replaying holographic images in real time 
or storing them for replay later. A series of digitally 
stored holograms may be made to create a holographic 
motion picture or the holograms can be broadcast 
electronically for replay at a remote site to provide 
holographic television (HoloVision) . Since a hologram 
stores amplitude and phase, with phase being directly 
proportional to wavelength and optical path length, 
direct-to-digital holography systems 10 and 40 may also 
serve as extremely precise measurement tools for 
verifying shapes and dimensions of precision components, 
assemblies, etc. Similarly, the ability to store the 
holograms digitally immediately provides a method for 
digital holographic interf erometry . Holograms of the 
same object, after some physical change (stress, 
temperature, micromachining, etc.), may be subtracted 
from one another (direct subtraction of phase) to 
calculate a physical measurement of the change, where the 
phase change is directly proportional to wavelength. 
Similarly one object can be compared to a like object to 
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measure the deviations of the second object from the 
first or master object, by subtracting the respective 
holograms . To unambiguously measure phase changes 
greater than 2n in the z-plane over two pixels in the x-y 
5 plane, holograms should be recorded at more than one 
wavelength . 

Systems 10 and 40 combine the use of high resolution 
digital recorders, such as video cameras, very small 
angle mixing of the holographic object and reference 

10 waves (e.g., mixing at an angle that results in at least 
two pixels per fringe and at least two fringes per 
spatial feature to be resolved) , imaging of the object at 
the recording (camera) plane, and Fourier transform 
analysis of the spatially low-frequency heterodyne (side- 

15 band) hologram to make it possible to record holographic 
images (e.g., images with both the phase and amplitude 
recorded for every pixel) . Additionally, an aperture 
stop may be used in the back focal plane of one or more 
lenses involved in focusing the object to prevent 

2 0 aliasing of any frequencies higher than can be resolved 
by the imaging system. No aperture is necessary if all 
spatial frequencies in the object are resolvable by the 
imaging system. 

Once recorded, it is possible to either replay the 

25 holographic images as 3-D phase or amplitude plots on a 
two-dimensional display or to replay the complete 
original recorded wave using a phase change crystal and 
white light or laser light to replay the original image. 
The original image is replayed by writing it in the 

30 phase-change medium with lasers, and either white light 
or another laser is used to replay it. By recording an 
image with three different colors of laser and combining 
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the replayed images, it is possible to make a true-color 
hologram. By continuously writing and replaying a series 
of images, it is possible to form holographic motion 
pictures. Since these images are digitally recorded, 
5 they can also be broadcast with radio frequency (RF) 
waves (e.g., microwave) or over a digital network of 
fibers or cables using suitable digital encoding 
technology, and replayed at a remote site. This 
effectively allows holographic television and motion 

10 pictures or 11 Hoi oVi si on. 11 

Systems 10 and 4 0 may also be embodied in a number 
of alternative approaches. For instance, systems 10 and 
4 0 may use phase shifting rather than heterodyne 
acquisition of the hologram phase and amplitude for each 

15 pixel. In another embodiment, systems 10 and 40 may use 
numerous different methods of writing the intensity 
pattern to an optically sensitive crystal. These include 
using a sharply focused scanning laser beam (rather than 
using a spatial light modulator) , writing with an SLM but 

20 without the biasing laser beam, and many possible 
geometric variations of the writing scheme. In an 
additional embodiment, systems 10 and 40 may use 
optically sensitive crystals employing optical effects 
other than phase change to create the diffraction grating 

2 5 to replay the hologram. In a further embodiment, systems 

10 and 40 may use a very fine-pixeled SLM to create the 
intensity pattern, thereby obviating any need to write 
the intensity pattern to an optically active crystal for 
replaying the hologram. 

3 0 As described above, systems 10 and 4 0 may be used to 

compare complex images obtained from the same object or 
target after a physical change occurs to the target or to 
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compare complex images from different targets. In 
addition, systems 10 and 4 0 may be used to acquire an 
image from different locations on target 20. The images 
at the different locations may have similar features. 
5 For example, target 2 0 may be a semiconductor wafer that 
includes multiple instances of a single die. In this 
example, systems 10 and 4 0 may be used to obtain complex 
images of a specific area on each of the die. Although 
the acquired images may have similar features, 

10 isoplanatic aberration values (e.g., the first order 

aberration term focus) associated with each image may be 
different. This difference may cause virtual, non- 
existing differences between the images. The aberration 
value of one of the images, therefore, should be adjusted 

15 to ensure that acquired complex images may be accurately 
compared . 

The present invention provides a solution to 
correcting the aberration values without increasing the 
time needed to acquire the complex images. Systems 10 
2 0 and 4 0 may be used to acquire two complex images from two 
different locations on target 20. First, the aberration 
range may be determined such that the aberration 
difference between the two images has a value between the 
determined limits. One or more aberration values within 

2 5 the determined aberration range may be selected and an 

aberration function may be calculated for each of the 
selected values. Second, the first complex image 
acquired by systems 10 and/or 40 may be iteratively 
modified by multiplying each of the aberration values by 

3 0 the first complex image in order to obtain a modified 

first complex image for each of the calculated aberration 
values. Third, each of the modified first complex images 
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may be compared with the second complex image. The 
comparison that yields the smallest variance between the 
modified first complex image and the second complex image 
in a high frequency range indicates the best 
5 approximation for correcting the aberration difference 
between the two complex images. In one embodiment, the 
procedure may be refined by using a finer selection of 
aberration values around the aberration value determined 
initially. In another embodiment, the procedure may be 

10 refined by using two best approximations for the best 
aberration value and interpolating a better aberration 
value between the two best approximations. 

In addition to aberration value differences between 
acquired images, other instrumentation changes may occur 

15 in systems 10 and 40 that cause artifacts to occur in the 
complex images. The artifacts may be small and may occur 
in the low frequency components of the complex images. 
In contrast, differences between two similar objects are 
typically small in size and thus, consist mainly of high 

20 frequency spatial components. In standard image 

processing, any artifacts resulting from changes in an 
image processing system may be removed in Fourier space. 
Artifacts resulting from changes in system 10 or 40, 
however, cannot be removed in Fourier space because each 

25 pixel in Fourier space is convoluted with the (complex) 
spectrum of the variation. 

Using the assumptions that the artifacts occur in 
the low frequency spatial components and any true 
differences between similar objects occur in the high 

3 0 frequency spatial components, changes in systems 10 and 
4 0 may be approximated by computing the difference 
between the low frequency components of the complex 
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images (as computed from the holograms) . To compensate 
for the changes, a low pass filter may be applied to the 
ratio of the complex images. The result may then be used 
as a multiplicative factor on one of the images, which 
compensates for the changes of the system. 

Mathematical description of the invention : 

A digital direct to holography system, such as 
systems 10 and 40, may record several complex images or 
holograms in the plane of the digital recorder. The 
recorder plane may be characterized by x-and y— 
coordinates. From the recorded holograms, the complex 
image waves of the recorder plane may be computed or 
reconstructed by applying a Fourier transform to the 
complex image waves. The Fourier transform of the waves, 
as reconstructed from the holograms, may contain 
isoplanatic aberrations, such as the first order 
aberration term focus. For example, the Fourier 
transform (FFT) of the image wave y/(x,y) may be written as 




where i 2 =—l 9 q x ,q are the coordinates in the Fourier plane 

and y/'(x,y)is the complex image wave at a different 
aberration value. % is the aberration function for each 
of the selected aberration values, and FFT and I FFT 
respectively represent the forward and inverse Fourier 
transforms. In order to determine small aberration 
differences between similar or identical images, at least 
two images should be compared. 
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in one embodiment, system 10 and/or 40 may acquire 
two complex images Wj {x,y) and yj^y) . where j is an 
integer. A Fourier transform may be applied to both and 
written such that their act 



:tual aberration values can be 



separated: 

F/rj^*, >)j = FFT^'j[x,y] 
FFtLJx, y]\ = FFt\ [x, y) 



exp 



•exp 



(2) 



(3) 



n,. =h P rration difference between 
From these equations, the aberration ax 

the two images may be described as: 



(4) 



FFT^ j+ {x,yj^/FFT- 




exp 




/exp 


- 



exp 



exp 



where » ^ «* 

similar features to image „>,y). the aberration 
function may not be direotly acoessible. However, 

for simiiar images, «» above equation is 
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a reasonable approximation. Therefore, if the difference 

Wj8.«,)-ZM,«,) between the imagSS ^ ¥i{X,y) " 

known, the first complex image may be modified to become: 



Vj 



'. = IFFT 



(5) 



which is ¥j at approximately the same aberration value as 
^ . The step to remove the aberration difference 
between two similar images, therefore, has been 
established by modifying image ¥j to match the aberration 

value of image ¥j+l ■ 

However, the above equation requires that the 
aberration value between the two complex images be known, 
in one embodiment, the aberration difference A ¥j+UJ 
between images ¥j (x,y) and y,„{x.y) may be calculated. If 
the images ¥j {x,y) and ¥j+l (x,y) are similar, then any 
detected difference may be smallest if the two images are 
compared using matching aberration values. This 
assumption may be important for highly periodic 
structures because the matching aberration values may 
occur at several periodic aberration values. In most 
cases, however, the true aberration value also provides 
the best match between the images and remains uniquely 

identifiable . 

in the described embodiments, the aberration 
difference between images ¥j (x,y) and ¥j+l (x,y) may be found 

U v 1 In one embodiment, the 
within a given range Umin'/Cmax J ■ 



AUS01:325029.l 



ATTORNEY DOCKET 
068062.0167 



23 



PATENT APPLICATION 



particular aberration may be a first order aberration, 
such as focus. In this embodiment, the aberration 
function, without derivation and being valid for high and 
low angle scattering, may be given by 



z(q x9 q y )=(2Tl/A)te sqrt 



\-q 2 X 2 1-1 



(6) 



or using the standard equation for focus 

x{q x ,q y )={2nl*)te q 1 ? (7) 

where X is the wavelength, Az is the selected focus 
value from the focus range and q = sqrt(q 2 x + q 2 y ) . In order 
to determine the actual aberration difference between the 
complex images, at least two aberration values may be 
selected from a predetermined range. The aberration 
function associated with each of the aberration values 
may then be calculated. Each of these calculated 
aberration values may then be substituted into the 
following equation 



yt n j - IFFT< FFT^y/ j j exp i Z x {q x .q^ 



(8) 



to compute an image modified by the aberration function. 
Each computed aberration function may be used to compute 
a modified image and each of the modified images may be 
compared with the image ys J+l {x,y) f for example, by 

computing the variance A l y,y+i of the expression: 
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A'yj+i^x 1 j = var mod^y' 1 j / ip J+l 



(9) 



Once % x o with the smallest A^.y+i is determined, or by 
interpolating between the two smallest values, the 
aberration difference is now known and can be 
successively eliminated. The two waves to be compared 
finally are: 



iff' 1 j = IFFT< 



y) 



: exp 



(10) 



(ii) 



Since the aberration value for the two complex images is 
approximately the same, the images may be accurately 
compared in a high frequency range to determine if any 
actual differences exist. By adjusting the aberration 
value associated with the first complex image, the second 
complex image does not have to be reacquired, which 
decreases the amount of time needed to obtain multiple 
images from target 20. 

As described above, artifacts caused by system 
specific changes may distort the actual differences 
between the images. These system specific changes that 
may occur between two complex images typically have a 
spectrum limited to lower frequencies, and the actual 
differences between target 20 and the resulting holograms 
are typically located in the higher frequencies. In 
general, two complex images i// j (x i y) and y/j^{x,y) t as 
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reconstructed from their respective holograms, may be 
described by: 

Wj{x 9 y) = ajcxp(*9j) < 12 > 
Wj+i (*> y) = a j+y ex p(<V; + i ) (13) 

The difference between image y/j{x,y) and image y/ J+l (x,y) may 
be characterized by the expression 

where a x exp(i<p x ) represents the artificial change between 
the two images caused by the changes in systems 10 and/or 
40 and a,exp(i'9>j) ~ a'. exp(/^)indicating the similarity 

between the two complex images. 

Since the artificial changes are limited to only 
lower frequencies, a low pass filter may be applied to a 
ratio of the first and second complex images as follows: 



IFFT\ 



LPF 



FFT 



v } {x>y)iy'j+\{x> y] 



(15) 



where y/ x {x 9 y) is the approximation for the artificial 

change between two images caused by any changes in 
systems 10 and/or 4 0 and LPF describes the low pass 
filter. In one embodiment, low pass filter may be a 
Butterworth filter. In other embodiments, low pass 
filter may be any suitable type of low pass filter that 
transmits the low frequency components associated with 
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the acquired images. Inserting y/j(x,y) and yf j+ y{x,y) in the 
above equation provides the following result: 



IFFT 



IFFT 



FFT 



* LPF 



(16) 



(a j /a J+l )exp i^p/ - <p j+l l Jpj h - <PjJ j 



*LPF 



where LPF = 1 for low frequency components, LPF = 0 for 
high frequency components, (P,- 1 and <p J+l ' respectively 
represent the low frequency components of image y/j{x,y) 
10 and image ^ +1 (x,y) and (p* and respectively represent 

the high frequency components of image y/j{x,y) and image 
y/ J+l {x,y) . The low pass filter, therefore, eliminates the 

high frequency components associated with the ratio of 
the images such that a low frequency ration is obtained. 
15 The result of the low pass filter is as follows: 



<l <Pj ~ <PjJ 



(17) 



where y/ x {x,y) represents the artificial changes present in 
20 systems 10 and/or 40. This result may then be multiplied 
by image i// J+l (x,y) to obtain the following modified image: 



v'i+x [*> y) = y y+ . [x, y) * y x (x> y) 



(18) 



AUS01 .325029. 1 



ATTORNEY DOCKET 
068062,0167 



PATENT APPLICATION 



27 



exp 



The modified image includes the high frequency components 
of image ys J+] (x 9 y) and the low frequency components of 

image y/j{x,y) such that when the modified image is 
compared with image y/j{x 9 y) only the high frequency 
components of each image remain as follows: 



10 



a j exp 



1 . h 
l\<Pj +<Pj 



= a j exp 



-, h 1 



*Vjj + i = exp 



(19) 



where Ay/j J+l (x,y) represents any actual differences between 
15 images Wj{x 9 y) and y/ J+l (x,y). Thus, the artificial changes 

created by systems 10 and/or 4 0 in the low frequency 
components of each image may be eliminated such that the 
actual differences between the two complex images may be 
determined by comparing the high frequency components of 

2 0 each image. 

FIGURE 3 illustrates multiple complex images 
acquired by systems 10 and/or 40. Specifically, image 32 
is a complex image from one location on target 2 0 at a 
first focus value and image 34 is a complex image from 

25 another location on target 20 at a second focus value. 
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5 



30 



image 36 is the complex image represented in image 32 
after computing and applying the focus difference between 
the two complex images. The aperture value used to 
obtain the images was approximately 0.5 nA and the focus 
correction is valid for high scattering angles 

FIGURE 4 and 5 illustrate differences between two 
complex image acquired by systems 10 and/or 40. 
Specifically, FIGURE 4 illustrates a difference between 
two complex images without compensating for artifacts 
caused by system changes. As shown, the image includes 
multiple artifacts that distort the image. FIGURE 5 
illustrates the difference image as shown in FIGURE 4 
after application of the low pass filter (described in 
detail above) to the ratio of the two acquired images. 
As shown, the artifacts introduced by small changes in 
systems 10 and/or 40 may be greatly reduced. In the 
illustrated embodiment, the bright white spots are 
defects and the defects that were not detectable in the 
image shown in FIGURE 4, may now be accurately 
represented since all of the low frequency components 
associated have been eliminated by the application of the 

low pass filter. 

FIGURES 6a and 6b illustrate a flow chart of a 
method for detecting differences between complex images. 
Generally, a direct- to-digital holography system may be 
used to acquire complex images that represent an object 
or target and determine if the acquired images have any 
actual differences. During an image acquisition process, 
changes in the holography system may occur that affect 
the accuracy of the acquired image. For example, if the 
holography system obtains similar images from two 
different locations on an object, each acquired image may 
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include a unique aberration value. The difference in 
aberration values may cause the holography system to 
determine that the acquired images are different, when 
the acquired images actually include the same features. 
5 In order to accurately acquire the image without 

affecting the speed of the image acquisition process, the 
first image acquired may be iteratively adjusted such 
that the first acquired image has the aberration value of 
the second acquired image. The modified first image may 

10 then be used to determine if the two acquired images have 
similar features. Other changes in the holography system 
may be approximated by computing the difference between 
the low frequency components for each image. In order to 
remove the low frequency components of the images, a low 

15 pass filter may be applied to a ratio of the images and 
the result may be used to modify one of the images to 
compensate for the changes of the holography system. Any 
differences in the images may then be detected in the 
high frequency components. 

20 At step 70, system 10 or 40 may acquire a first 

complex image from target 20. In one embodiment, target 
20 may be an electronic device fabricated from silicon, 
germanium, or any compound including a group III and/or 
group IV elements. In another embodiment, target 20 may 

25 be a photomask or reticle including a pattern formed on a 
substrate. In other embodiments, target 2 0 may be any 
object, component or assembly that may be analyzed by 
systems 10 and 40 in order to verify shapes and 
dimensions. At step 72, a second complex image may be 

30 acquired from target 20. The second complex image may be 
acquired from the same object to calculate a physical 
change in the object or the second complex image may be 
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acquired from a like object to measure deviations of the 
second object from the first object. 
At step 73, system 10 and/or 40 determined if an 
aberration correction is needed to match the first and 
5 second images. If the aberration value for the second 
image is different than the aberration value for the 
first image, an anticipated aberration range may be 
determined at step 74. The anticipated range may be 
based on previously determined values associated with a 

10 specific object or estimations based on the type (e.g., a 
semiconductor wafer, a photomask, etc.) of object. In 
order to converge on the actual aberration difference 
between the first and second images, at least two 
aberration values may be selected from the range at step 

15 76. In one embodiment, two best values may be selected 
and an estimated aberration difference may be 
interpolated by using the two best values. In another 
embodiment, multiple values may be selected. At step 78, 
each of the selected aberration values may be used to 

2 0 calculate an aberration function. In one embodiment, the 

aberration function may be used to calculate a first 
order aberration value such as focus. 

At step 80, the calculated aberration function may 
be used to iteratively modify the first complex image. 
25 In one embodiment, a Fourier transform may be applied to 
the first complex image and this result may be multiplied 
by the aberration function. This process may be repeated 
for each of the calculated aberration functions such that 
the first complex image may be modified multiple times. 

3 0 An inverse Fourier transform may be performed on the 

modified first complex image after each of the aberration 
functions is applied in order to convert the modified 
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acquired complex images may contain artifacts caused by 
changes in systems 10 and/or 40, These artifacts may 
exist in the low frequency components associated with the 
images while any actual differences may exist in the high 
5 frequency components. In order to effectively remove the 
low frequency components from the comparison of the 
modified first complex image and the second complex 
image, a low pass filter may be applied to the ratio at 
step 90. In one embodiment, a Fourier transform may be 

10 applied to the ratio such that the ratio of the images is 
converted to the frequency domain and the low pass filter 
may be applied in the frequency domain. An inverse 
Fourier transform may then be applied to convert the low 
frequency ratio back to the time domain. 

15 At step 92, the low frequency ratio may be 

multiplied by the second complex image to obtain a 
modified second complex image. By applying the low 
frequency ratio to the second complex image, the low 
frequency components of the second complex image are 

2 0 replaced with the low frequency components of the first 
image. The modified second complex image may then be 
compared to the modified first complex image at step 94. 
In this comparison, only the high frequency components 
associated with each of the first and second complex 

2 5 images are compared in order to determine any actual 

differences between the images. The system determines if 
the high frequency components of the two images are 
approximately the same at step 96. If there is no 
difference between the modified first complex image and 

30 the modified second complex image, systems 10 and/or 40 
determine that the images are similar at step 98. If a 
difference is determined, the difference may be recorded 
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at step 100. In one embodiment, target 2 0 may be a 
semiconductor wafer and the calculated difference between 
images may indicate a defect at a particular location on 
the wafer. 

Although the present invention has been described 
with respect to a specific preferred embodiment thereof, 
various changes and modifications may be suggested to one 
skilled in the art and it is intended that the present 
invention encompass such changes and modifications fall 
within the scope of the appended claims. 
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